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In  all  cases,  the  target  aircraft  Is  considered  as  passive  and  unaware  of  attack. 


This  paper  makes  the  logical  extension  to  the  above  research,  and  attempts  to 
develop  a  method  by  which  the  capability  of  the  attacker  may  be  defined  against  an 
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"capture"  regions;  the  converse,  for  the  target,  are  "escape"  regions. 
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information  differential  game.  The  participants'  dynamics  are  modelled  upon  art  F4 
type  aircraft,  the  game  state  space  is  defined,  and  the  regions  modelled  mathematicall 
An  original  extension  to  classical  differential  game  theory  is  then  made  by  which  it  is 
shown  that  partitions  of  the  game  space  into  escape  and  capture  regions  can  be  made 
for  the  simple  planar  game  models.  These  regions  are  separated  by  a  boundary  whiel  will 
be  called  a  "P^  barrier."  Obviously,  the  extent  of  the  region  from  which  the  attacker 
can  "capture"  a  given  value  is  a  measure  of  hia  capability  against  the  evasive, 
fully- informed  target. 

The  theoretical  development  is  applied  to  two  planar  game  models.  Numerical  methods 
are  used  to  generate  optimal  trajectories  by  backward  integration  from  admissable 
terminal  conditions  for  the  game.  These  trajectories  are  analyzed,  and  partitions,  or 
Pk  barriers,  are  shown  to  exist.  Examples  of  the  escape  and  capture  regions  are  shown, 
within  the  limits  of  the  graphical  techniques  currently  available. 

Two  major  conclusions  are  made.  From  the  analytic  viewpoint,  the  methods  developed 
show  that  partitions  of  the  game  space  are  possible  for  this  class  of  game.  Refinement 
of  these  methods  would  realize  the  potential  of  this  form  of  analysis  in  defining  the 
capability  of  an  attacking  aircraft  in  a  variety  of  air  combat  situations.  In  the  prac¬ 
tical  sense,  it  is  shown  that  the  particular  weapon  system  modelled  here  has  severe 
limitations  when  employed  against  an  intelligent  enemy.  Although  the  analysis  was 
’"estricted  to  two-dimensional  maneuver  for  both  aircraft,  it  is  felt  that  generalization 
.  the  methods  to  three  dimensions  would  reinforce  the  two-dimensional  conclusions. 
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Preface 

This  work  is  the  outcome  of  my  efforts  to  analyze  the  capability  of 
a  fighter  aircraft  equipped  with  a  heat-seeking,  air-to-air  missile  in 
pursuit  of  an  intelligent  and  evasive  target  aircraft.  Based  upon  classical 
differential  game  theory,  an  original  method  of  analysis  is  developed  by 
which  escape  and  capture  regions  for  each  airerift  may  be  defined.  The 
capability  of  the  pursuing  aircraft  can  then  be  measured  by  the  extent  of 
the  regions  from  which  it  can  achieve  a  specified  probability  of  killing 
the  target  at  missile  launch.  The  analysis ,  and  its  application  to  planar 
game  models,  represents  the  initial  steps  toward  complete  definition  of 

escape  and  capture  regions  for  this  class  of  differential  games. 

0 

The  thesis  received  its  original  inspiration  from  studies  being  con¬ 
ducted  at  the  United  States  Air  Force  Armament  Laboratory,  Eglin  AFB , 
Florida.  These  studies  were  basically  concerned  with  the  capability  of 
an  F4-E  In  air-to-air  combat  against  a  passive  target  aircraft,  and  this 
work  makes  the  logical  extension. 

In  concluding  the  paper,  I  would  like  to  mention  the  debts  I  incurred 
during  its  development.  My  advisor.  Professor  Gerald  M.  Anderson  of  the 
Air  Force  Institute  of  Technology  contributed  much  in  originality  and 
advice.  My  thanks  also  go  to  the  staff  of  the  Missile  Systems  and  Analysis 
Division  of  the  USAF  Armament  Laboratory  at  Eglin,  with  whom  I  had  the 
pleasure  of  working  for  some  eleven  weeks  during  the  crucial  phases  of 


the  research. 
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Abstract 
*  “ - - 

The  motivation  for  this  thesis  originates  in  research  currently 
being  conducted  at  the  USAF  Armament  Laboratory,  Ejlin  AFB,  Florida. 

These  studies  concern  the  performance  of  an  F4-E  aircraft  in  air-to-air 
combat;  the  weapon  system  considered  is  an  infra-red,  heat-seeking 
missile.  The  studies  fall  into  two  categories: 

(a)  Definition  of  those  regions  in  the  vicin'  ,  of  a  target  air- 
era-.  which  the  attacker  must  penetrate  in  order  t attain  a  probability 
of  killing  his  opponent  greater  than  2ero. 

(b)  Definition  of  optimal  strategies  for  the  attacker  to  inter¬ 
cept  and  penetrate  the  high  probability  of  kill  (P^)  regions. 

$ 

In  all  cases,  the  target  aircraft  is  considered  as  passive  and  unaware 
of  attaesc. 

This  paper  makes  the  logical  extension  to  the  above  research,  and 
attempts  to  develop  a  method  by  which  the  capability  of  the  attacker  may 
be  defined  against  an  intelligent  and  evasive  target.  The  primary  objec¬ 
tive  is  to  obtaiii  regions  for  both  aircraft  which  define  or  enclose  those 
points  in  the  game  state  space  from  which  the  attacker  can  alway-3  pene¬ 
trate  to  a  given  probability  of  kill.  These  regions  are  called  "capture" 
regions;  the  converse,  for  the  target,  are  "escape"  regions. 

The  air-to-air  combat  encounter  is  considered  as  a  free  time,  zero 
sum,  perfect  information  differential  game.  The  participants'  dynamics 
are  modelled  upen  an  F4  type  aircraft,  the  game  state  space  Is  defined, 
and  the  regions  modelled  mathematically.  An  original  extension  to 
classical  differencial  game  theory  is  then  made  by  which  it  is  shew, 
that  partitions  of  th*  game  space  into  escape  and  cuoture  regions  can 
be  made  for  the  simole  planar  game  models.  These  regions  are  separated 
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by  a  boundary  which  will  be  called  a  "PK  barrier."  Obviously,  the.  ex¬ 
tent  of  the  region  from  which  the  attacker  can  "capture"  a  given  Pjr 
value  is  a  measure  of  his  capability  against  the  evasive,  fully- informed 
target. 

The  theoretical  development  is  applied  to  two  planar  game  models. 
Numerical  methods  are  used  to  generate  optimal  trajectories  by  backward 
integration  from  admissable  terminal  conditions  for  the  game.  These 
trajectories  are  analyzed,  and  partitions,  or  PK  barriers,  are  shown  to 
exist.  Examples  of  the  escape  and  capture  regions  are  shown,  within  the 
limits  of  the  graphical  techniques  currently  available. 

Two  major  conclusions  are  made.  From  the  analytic  viewpoint,  the 
methods  developed  show  that  partitions  of  the  game  space  are  possible 
for  this  class  of  game.  Refinement  of  these  methods  would  realize  the 
potential  of  this  form  of  analysis  in  defining  the  capability  of  an 
attacking  aircraft  in  a  variety  of  air  combat  situations.  In  the  prac¬ 
tical  sense,  it  is  shown  that  the  particular  weapon  system  modelled  here 
has  severe  limitations  when  employed  against  an  intelligent  enemy.  Al¬ 
though  the  analysis  was  restricted  to  two-dimensional  maneuver  for  both 
aircraft,  it  is  felt  that  generalization  of  the  methods  to  three  dimen¬ 
sions  would  reinforce  the  two-dimensional  conclusions. 
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I .  Introduction 

The  two  aircraft  pursuit-evasion  problem  has  received  a  great  deal 
of  attention  from  researchers  in  recent  years.  The  basic  objective  of 
the  research  has  been  to  find  analytical  or  numerical  means  of  evaluating 
the  effectiveness  of  one  aircraft  in  competition  with  another.  Many 
different  situations  arise  dependent  chiefly  upon  the  relative  capabili¬ 
ties  of  pursuer  and  evader,  and  the  types  of  airborne  weapons  employed. 

Much  of  the  previous  effort  has  been  directed  towards  obtaining 
optimal  strategies  for  pursuer  and  evader.  These  strategies  arise 
directly  from  solutions  to  a  given  problem  using  differential  game  theory. 
Open,  (and,  in  some  cases  closed)  loop  control  laws  can  be  obtained  which 
define  optimal  play  for  each  aircraft.  However,  this  approach  makes  the 
assumption  that  the  pursuer  is  initially  in  a  position  to  force  termina¬ 
tion.  Alternatively,  optimal  strategies  can  be  obtained  for  an  aircraft 
attacking  a  passive  target.  The  major  failing  in  this  case  is  that  the 
resulting  strategies  are  non-optlmal  against  a  target  which  deviates  from 
its  specified  trajectory. 

This  thesis  approaches  the  pursuit-evasion  game  in  what  is  believed 
to  be  an  original  manner.  The  problem  is  considered  as  an  extension  of 
the  Isaacs  "game  of  kind"  (Ref  (3)).  Termination  of  the  game  is  defined 
when  the  pursuirg  aircraft  reaches  a  specified  value  (payoff)  at  the 
terminal  time  (tj)  and  is  boresighted  on  the  evader.  If  the  pursuer  can 
attain  a  higher  payoff  than  that  specified  and  maintain  boresipht,  cap¬ 
ture  is  said  to  occur.  If  the  evader  prevents  the  pursuer  reaching  the 

* 

specified  ticruiiriwl  cor*d  it  ion*!  <  escape  is  5  3  1  d  to  c  rru  r  U  u  i  n  p  f  His 

extended  concept  from  differential  game  theory,  the  intent  of  this  thesis 
is  to  develop  a  method  of  partitioning  the  game  state  space  into  escape 
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and  capture  regions.  Definition  of  such  regions  for  a  given  aircraft/ 
weapon  system  could  have  a  significant  impact  on  tactics  and  design. 

The  payoff,  or  value,  of  the  game  Is  defined  in  terms  of  the  pur¬ 
suer's  probability  of  kill  (Pj()  if  a  missile  *s  launched  at  tf.  Contours 
of  constant  Fj;  are  modelled,  and  the  pursuer  then  attempts  to  reach  as 
high  a  value  of  as  possible  (with  boresight)  before  firing. 

Two  constant  altitude  models  of  the  pursuit-evasion  game  are 
developed,  in  the  first  -*  ^hich  both  aircraft  are  constrained  to  con¬ 
stant  velocity;  the  second  model  permits  variable  velocity  dependent 
upon  thrust  and  drag  forces.  Chapter  11  introduces  the  game  models, 
while  Chapter  III  presents  the  theoretical  aspects  of  differential  game 
theory  employed  in  the  solution  approach.  Chapter  IV  then, develops  a 
method  of  specifying  the  admissible  end  points  for  the  free  time  differ¬ 
ential  game. 

Having  specified  a  set  of  admissible  end  points,  numerical  backward 
Integration  is  used  to  obtain  optimal  trajectories.  Chapter  V  presents 
the  solutions  for  the  constant  velocity  model,  and  discusses  the  means 
by  which  partitions  of  the  game  apace  can  be  made.  Some  aspects  of  the 
variable  velocity  model  are  considered  in  Chapter  VI,  and  Chapter  VII 
presents  a  general  discussion  of  the  results  and  their  possible  implica¬ 
tions.  Conclusions  and  recommendations  are  contained  in  Chapter  VIII. 

It  is  felt  that  this  research  makes  several  contributions  to  the 
study  of  differential  games  and  pursuit-evasion  problems.  As  far  as  is 
known,  no  previous  attempts  have  been  made  to  define  escape  and  capture 
regions  for  this  class  of  game.  Thus,  the  solution  method  employed  has 
some  interesting  elements  of  originality.  Secondly,  successful  defini¬ 
tion  of  escape  and  capture  regions  allows  a  unique  method  of  comparing 
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the  capabilities  of  different  aircraft,  -r  of  different  weapon  systems. 
Although  the  approach  needs  much  refinement,  it  has  great  potential  in 
the  design  and  tactical  application  of  airborne  weapon  systems. 
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II  *  Statement  of  the  Problem 
Origins  ef_  the  Problem 

The  problem  considered  here  owes  its  origin  to  studies  in  progress 
at  the  U5AF  Armament  Laboratory.  These  studies  concern  the  performance 
of  an  F4  type  aircraft,  equipped  with  a  short-range  missile,  when  employed 
against  a  passive  target  aircraft.  Two  major  areas  are  considered.  First¬ 
ly,  the  definition  nf  those  regions  in  the  vicinity  of  the  target  where 
the  attacker's  probability  of  kill  (Pj.)  is  greater  than  2ero,  Secondly, 
the  investigation  of  optimal  strategies  for  the  attacker  which  permit  him 
to  penetrate  the  Pg;  regions. 

The  question  naturally  arises  as  to  the  attacker's  capability  when 
the  target  assumes  an  intelligent,  and  hence  evasive,  role.  This  is 
the  problem  addressed  by  this  thesis. 

Thesis  Objectives 

The  primary  objective  is  to  develop  a  method  by  which  the  state  space 
for  a  two  aircraft  pursuit-evasion  game  may  be  partitioned  into  escape  and 
capture  regions.  A  capture  region  is  defined  as  that  region  containing 
all  starting  points  for  the  game  from  which  the  pursuer  can  exceed  a 
specified  P^Ctj)  with  bore.sight.  An  escape  region  is  the  converse.  The 
boundary  which  separates  these  regions  will  be  defined  as  a  "Pg-  barrier." 

The  secondary  objective  is  to  consider  the  dependence  of  those  re¬ 
gions  on  the  various  parameters  of  the  game,  and  what  impact  definition 
of  the  regions  nay  have  on  tactics  and  design. 

Gnrnc  Scenario 

The  game  scenario  has  the  following  essential  ingredients: 

(a)  The  dynamics  of  both  aircraft  are  bared  upon  the  F4  with  variable 
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individual  characteristics. 

(b)  The  pursuer  is  equipped  with  a  short-range,  heat-seeking ,  air- 
to-air  missile,.  The  pursuer  must  be  boresighted  on  the  evader  before 
firing  the  missile  in  order  to  permit  seeker  lock-on. 

(c)  Regions  where  the  pursuer  has  a  >  0  are  defined,  which  the 
pursuer  attempts  to  penetrate  before  firing. 

(d)  Maneuvering  is  limited  to  the  horizontal  plane. 

It  is  recognized  that  the  restriction  at  (d)  above  limits  direct 
practical  application.  However,  assuming  planar  maneuvers  reduces  the 
dimensions  of  the  game  space,  and  hence  of  the  solution  trajectories, 
which  in  turn  allows  a  more  simple  approach.  So  great  is  the  problem  of 
dimension,  that  the  further  restriction  of  constant  velocity  is  also  im¬ 
posed  in  the  initial  analysis. 

Aircraft  Model 

The  following  assumptions  are  made  in  respect  of  the  aircraft  models: 

(a)  A  flat  earth  with  constant  gravitational  acceleration. 

(b)  The  aircraft  are  point  masses. 

(c)  Thrust  is  a  linear  function  of  velocity,  and  is  tangent  to  the 
aircraft  flight  path. 

(d)  Aircraft  weight  is  constant. 

(e)  Aircraft  load  factor  (n)  is  governed  by 

n  <  5  (2-1) 

(f)  The  load  factor  for  lift  limited  flight  is  a  linear  function 
of  velocity. 

( o-'l  Tli**  nnl  .ir  r^in 

'  O'  —  '  O  1  -  *'  ~  —  —  -  T_.  _ -  ~ 


GA/KC/73-4 


The  aircraft  model  is  presented  in  detail  in  Appendix  A, 

Target  Set  Model 

The  target  set  is  defined  as  that  region  in  the  vicinity  of  the 
target  aircraft  where  the  attacker's  is  greater  than  zero.  The  model 
used  in  this  approach  is  shown  in  Figure  1  overleaf.  The  target  set  is 
modeled  as  elliptical  contours, of  constant  PK.  The  paint  5000  ft  directly 
to  the  rear  of  the  evader  has  a  Pj^  of  1.0.  The  zero  Pj,  contour  is  an 
ellipse  of  serai-minor  axis  (a)  3000  ft  and  semi-major  axis  (b)  6000  ft 
centered  at  the  Pjj  «  1.0  point.  Thus,  for  example,  the  concentric 
ellipse  with  a  »  2000  ft  and  b  ■  4000  ft  represents  a  of  5/9. 


State  Equations  of  Motion  > 

The  dynamic  equations  are  written  in  a  non-rotating  frame  fixed  on 
the  evader,  as  shown  in  Figure  2  (Page  8).  The  state  vector  is 


±  Pursuer's  position  in  Xj-direction 

x2  A.  Pursuer's  position  in  X2~di rection 

*3  A  Pursuer's  heading 

*4  A  Evader's  heading 

x5  A  Pursuer's  velocity 

x6  A  Evader's  velocity 


Uuing  the  aircraft  model  developed  in  Appendix  A,  the  state  equa¬ 
tions  of  motion  may  then  be  written 

*  X3CO8  X3  -  X^COS  X4 


*2  ■  x,jsin  x^  -  x^sin  x^ 

«  Riu 

Xi  -  — H 


(2-3) 


*5 
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f 

? 

s 


A1  +  A2x5  +  A3x52  +  (u„2  +  1)  +  £§__  (u  2  +  X)2 


x5 


2  P 


*5 


2  P 


x6  "  Ai  +  A2Xg  +  A3Xg  +  (ug2  +  1)  +  (u2  +  1)2 

»\  A  * 


*6 


He 


where  Up  and  ug  are  the  pursuer's  --u’j  evader's  controls  respectively. 
If  the  aircraft  velocities  are  constant  the  Eq  (2-3)  becomes 

*1  "  Vpcos  x3  -  Vecos  x4 

x2  "  vp9in  x3  "  vesin  x4 


*  8Un 

*1  -  - t- 


(2-4) 


i,  - 


where  Vp  and  Vg  are  the  pursuer  and  evader  velocities  respectively. 
Target  Set  Equation 

In  the  selected  frame  of  motion,  the  target  set  equation  is 


PK 


(2-5) 


^  (5000  +  x^  cos  x4  +  *2  8ln  x4' 

(-xi  sin  x4  +  :<2  cos  x4)2 
K'-a*- 

where  p  **  3000  ft.  The  constant  "Ku  defines  the  eccentricity  of  the 
elliptical  contours.  In  all  cases  considered,  K  is  set  to  a  value  of  2.0. 


Bo re- sight  Condition 

The  bore-sight  condition  (*)  is  placed  on  the  pursuer  to  enable 
acquisition  of  the  target  by  the  missile  seeker  prior  to  firing.  Math¬ 
ematically  stated  it  is 
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X(x(t£))  -  tan  x3  -  ^  -  0  (2-6) 

Summary  of  the  Problem  formulation 

The  variable  velocity  model  is  formulated  with  a  six-dimensional 
state  vector;  the  constant  velocity  model  with  a  four-dimensional  state 
vector.  Mathematically,  the  number  of  states  could  be  reduced  by  one 
in  each  case,  since  a  relative  heading  variable  could  replace  individual 
pursuer  and  evader  headings.  However,  there  are  mathematical  advantages 
In  solution  with  the  equations  in  their  stated  form. 

The  models  have  the  following:  major  restrictions: 

(a)  Constraint  to  motion  in  a  plane  is  unrealistic,  since  violent 
out-of-plane  maneuvers  can  be  expected  in  real  air  combat.  t 

(b)  The  dynamics  of  the  variable  velocity  model  are  valid  only 
for  Mach  No  _<  0.9. 

Tha  restrictions  certainly  limit  the  practical  reality  of  the  re¬ 
sults,  but  a  simple  model  of  reduced  dimension  offers,  at  least  initially, 
a  better  opportunity  of  developing  a  solution  method.  Even  in  the. 
cases  considered  capture/escape  regions  are  3-dimenslonal  for  the  con¬ 
stant  velocity  model,  and  5-dimensional  for  variable  velocity.  These 
dimensions  cause  severe  practical  difficulties  in  comprehension  and 
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III.  Differential  Game  Theory 

The  problem  treated  in  this  thesis  is  formulated  as  a  free  time, 
zero-sum,  perfect  information  differential  game,  and  the  first  require¬ 
ment  is  to  establish  unique  solutions  for  the  game.  The  solution  trajec¬ 
tories  obtained  must  then  be  analyzed  to  determine  whether  the  game  state 
space,  G,  is  partitioned  into  escape  and  capture  regions.  The  purpose 
of  this  chapter  is  to  define  this  class  of  games  mathematically  and  to 
summarize  those  claments  of  differential  game  theory  which  are  subseauently 
employed.  The  basis  for  this  theory  is  contained  in  references  (1),  (2) 
and  (3). 

Class  of  Game  , 

The  objective  of  the  differential  game  is  to  find 

min  max  J  »  *  (x(t£>)  (3-1) 

u  v 

subject  to  the  dynamic  constraints 

x  -  f(x,u,v,t)  ,  x(t0)  *  Xq  (3-2) 

and  the  algebraic  terminal  constraint 

X(x(tf)>  *  U  (3-3) 

where  x  is  the  n-dimensional  state  sector,  u  is  the  pursuer's  control 
and  v  is  the  evader’s  control,  u  and  v  may  be  subject  to  constraints. 

The  aim  is  to  find  the  controls  u*  and  v*  such  that 

J(u*,v)  J(u*,v*)  <_  J (u ,v*)  (3-4)  ' 

If  the  pair  (u*,v*)  can  be  found,  they  constitute  a  saddle  point  solution 
of  the  game  and  J(u*,v*)  is  called  the  value  of  the  game. 
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Kecessary  Conditions  for  a  Solution 

The  existence,  of  a  solution  is  dependent  upon  the  fact  that 

min  max  J(u,v)  -  max  min  J(u,v)  (3-5) 

u  v  v  u 

A  necessary  condition  for  a  saddle  point  solution  is  that  the 
Hamiltonian  (K)  defined  as 

“  A.T£  (3-6) 

must  be  minimized  over  the  admissable  set  of  u  and  maximized  over  the 
admissable  set  of  v  such  that 

H*  *  min  max  H  »  max  min  H  (3-7) 

U  V  V  U 

\  is  the  n-dituensional  costate  vector  and  , 

i  -  -  Hx  (3-8) 

subject  to  the  transversallty  conditions 

A<tf)  «  *x(tf)  +  vxx(cf)  (3-9) 

H(tf)  -  *t(t£)  +  vXt(tf)  (3-10) 

vhere  v  is  an  arbitrary  constant  multiplier. 

Further,  if  t  does  not  appear  explicitly  in  Eq  (3-6)  then  H  is  con¬ 
stant.  An  important  outcome  of  this  condition  is  that  H,  <j>  and  x  are  not 
functions  of  t  in  the  problem  considered  and  condition  (3-10)  mav  then 
be  written 

H<t)  -  H(tf)  «  0  (3-11) 

Eq  (3-7)  implies  that  the  maximization  and  minimization  of  H  commute, 
which  is  not  true  in  general.  It  is  true,  however,  if  H  is  separable 
into  two  functions,  one  of  wnich  is  independent  of  v,  the  other  independent 
of  U,  For  the  problems  considered  in  this  thesis,  f  and  hence  H  is 
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separable.  This  insures  chat  the  minimizing  u  and  maximizing  v  provide 
a  saddle  point  in  II  at  each  point  of  the  optimal  path. 

Singular  Controls 

When  the  controls  u  and  v  appear  linearly  in  Eq  (3-6) ,  then  the 
possibility  of  solution  arcs  with  singular  controls  exists.  In  the  case 
of  the  constant  velocity  model,  this  situation  arises  and  singular  arcs 
occur.  The  necessary  and  junction  conditions  for  such  arcs  are  discussed 
in  Appendix  B. 

Gaines  of  Kind 

Isaacs  (Ref  (3))  introduces  the  concepts  of  the  "game  of  kind"  and 
the  "game  of  degree."  In  the  game  of  kind,  the  primary  concern  is  whether 
or  not  termination  (as  defined  for  the  game)  occurs.  This  contrasts  with 
the  game  of  degree  where  termination  is  assumed  to  occur,  and  the  player's 
objectives  are  to  hasten  or  delay  termination,  or  to  minima*  a  continuous 
payoff.  The  differential  game  is  considered  here  in  the  context  of  a  game 
of  kind,  the  object  being  to  determine  whether  termination  occurs  from  a 
given  set  of  starting  conditions. 

The  Barrier  Concept .  A  game  of  kind  in  the  game  space  C  is  assumed, 
with  a  terminal  surface  X  specified.  P  attempts  to  penetrate  X,  while 
E  attempts  to  prevent  penetration.  There  are  three  possible  outcomes 

(a)  P  penetrates  X  (capture) 

(b)  P  does  not  penetrate  X  (escape) 

(c)  P  just  reaches  X,  but  does  not  penetrate. 

The  "neutral"  outcome  at  (c)  is  that  of  significance,  since  the 
trajectory  resulting  in  (c)  is,  in  a  sense,  the  only  one  on  which  the 
strategies  of  P  and  E  are  decisive.  That  is,  non-ontimal  play  by  E  will 
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result  in  P  penetrating  X,  while  non-optimal  play  by  P  will  result  in  E's 
escape. 

the  assumption  now  made  is  that  G  contains  starting  points  which 
result  in  either  capture  or  escape.  Generally,,  these  points  will  fall 
into  regions  which  are  separated  by  a  surface  consisting  of  those  starting 
points  for  which  the  outcome  is  neutral.  This  surface  is  a  "barrier", 
an  example  of  which  may  be  seen  in  the  "Homicidal  Chauffeur  Game1'  analyzed 
by  Isaacs  (Ref  (3)),  The  barriers  give  vital  information  on  the  relative 
capabilities  of  P  and  E,  and,  if  they  are  shown  to  enclose  entirely  some 
portion  of  G,  then  the  space  is  automatically  divided  into  escape  and 
capture  regions. 

Construction  of  the  Barrier.  This  section  summarizes  Isaacs’  work 
in  Ref  (3).  The  termination  of  the  problem  is  assumed  at  tf.  A  neutral 
outcome  demands  that,  while  P’s  path  touches  X,  it  does  not  penetrate. 
Physically,  this  is  equivalent  to  P  having  a  zero  rate  of  penetration  at 
tf,  or  that  the  component  of  P's  velocity  normal  to  x  is  zero.  Math¬ 
ematically  this  can  be  written 

xj(tf)*(tf)  -  0  (3-12) 

If  a  Lagrange  multiplier  c  is  defined  such  that 

Hq  *  aTx  ■  a^f  (3-13) 

find  «(tf)  -  xx(tf)  (3-14) 

then  Eq  (3-12)  can  be  written 

H^tj)  -  0  (3-15) 

where  is  defined  as  the  "Barrier  Hamiltonian." 

A  point  on  x  where  Eq  (3-15)  is  satisfied  is  called  the  "Boundary 
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of  the  Useable  Part"  (BUP),  since  it  separates  those  portions  of  x  where 
P  has  a  positive  rate  of  penetration  (the  Useable  Part)  ami  a  negative 
rate  of  penetration  (Non-useable  Part). 

There  is  an  obvious  equivalence  between  l>s  (3—6)  and  (3-13).  In 
fact,  in  the  absence  of  J,  they  are  identical.  Thus,  a  backward  integra¬ 
tion  of  Eqa  (3-2)  and  (3-8)  subject  to  solution  of  Eq  (3-15)  and  the 
necessary  conditions  yields  the  classical  Isaacs  barrier. 


The  Dispersal  Surface 

The  concept  cf  the  dispersal  surface  (DS)  (Ref  (3))  is  one  which 
has  an  important  bearing  on  the  analysis  of  a  differential  game  solution. 
Generally,  there  are  two  aspects  to  the  given  game  solution.  One  is 
solution  "in  the  small"  where,  assuming  x(tf)  and  ^(tf)  are  known , 
backward  integration  will  yield  a  solution  trajectory.  However,  there 
exist  singular  surfaces  in  the  G- space  which  delineate  regions  of  differ¬ 
ent  behavior  of  the  dynamic  equations.  Ascertaining  these  surfaces  is 
termed  the  solution  "in  the  large."  The  implication  of  the  existence 
of  singular  surfaces  is  that  solutions  "in  the  small"  may  be.  invalidated 
because  of  the  presence  of  these  surfaces. 

A  differential  game  is  assumed,  where  optimal  trajectories  have 
been  obtained  ,sy  *  steward  integration  of  the  dvnamic  equations.  Suppose 
also  that  the  paths  obtained  fall  into  2  classes  and  that  paths  from 
each  class  intersect  as  suggested  by  Figure  3.  If,  at  the  point  of 
intersection,  the  states  are  identical,  and  the  values  (payoffs)  for 
each  path  are  equal,  then  the  intersection,  is  a  point  on  a  DS.  The  locus 


ul  ouui  a  x  a  h-iic  l. 
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Points  on  the  DS  may  also  be  considered  as  confronting  E  with  a 
dilemma  in  choice  of  strategy,  either  choice  resulting  in  an  equal  value 
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at  termination.  The  importance  of  the  DS  is  that  it  provides  a  method  of 
terminating  trajectories,  and  in  a  given  problem  may  well  provide  the  key 
to  partitioning  G. 

The  Solution  Method 

The  major  observation  from  the  preceding  sections  arises  from  the 
comparison  of  Eqs  (3-6)  and  (3-13).  The  multipliers  _X  and  a  are  not 
equivalent  since  a_(t^-)  contains  no  influencing  term  in  $x  as  does  X(tf) 
in  Eq  (3-9).  Thus,  In  effect,  an  entirely  new  problem  is  posed.  Not 
only  does  P  have  to  maneuver  so  as  to  attain  boresight,  but  has  also  to 
penetrate  a  region  where  he  has  a  >  0. 

The  terminal  conditions  obtained  are  not  analogous  to  the  BUP,  which 

0 

is  principally  dependent  on  a  zero  rate  of  penetration  of  a  specified 
terminal  surface.  The  terminal  states  in  the  present  game  art',  a  combina¬ 
tion  of  both  the  ability  of  P  to  reach  C,  and  to  satisfy  the  boresight 
condition.  These  two  constraints  together  render  the  classical  approach 
inapplicable.  Hence  barrier  trajectories  of  the  type  developed  by  Isaacs 
do  not  exist  for  this  problem,  and  the  development  of  P^  barriers  must 
then  be  accomplished  by  analysis  of  the  solution  trajectories. 

The  approach  is  based  on  the  foregoing  observations  on  classical 
theory.  A  particular  Pg  contour  is  specified  as  the  terminal  objective, 
and  an  admissable  set  of  terminal  conditions  determined.  Optimal  paths 
can  then  be  generated  by  backward  integration,  and  analyzed  to  obtain  the 
Pjr  barriers. 

It  is  interesting  to  note  that  a  BUP  in  the  Isaacs  sense  would  exist 
for  this  problem  if  the  boresight  condition  (Eq  (3-3))  above  were  con¬ 
sidered.  This  classical  BUP  is  discussed  briefly  in  Chapter  TV. 
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IV.  Determination  of  Admis sable  Terminal  Conditions 

One  method  approaching  the  solution  of  the  pursuit-evasion  problem 
defined  in  this  thesis  is  to  use  a  backward  integration  technique.  This 
implies  complete  specification  of  an  admissable  terminal  point  for  the 
game.  The  purpose  of  this  chapter  is  to  develop  a  method  whereby  admissable 
terminal  conditions  may  be  specified. 

Mathematical  Formulation 

Constant  Velocity  Model .  Based  upon  the  game  model  presented  in 
Chapter  II,  the  dynamic  equations  are 

■  VpCOS  -  V^cos 
*2  *  Vpsin  x3  -  Vesin  X£ 

(4-1) 


*3  "  ~  “p 
VP 


x2 

H 

A4 


0 

0 


Vp(X^sin  -  X^c.os  x^) 
Ve(-Xxsin  x/,  +  X2COS  X4) 


The  terminal  bores ight  constraint  is 


Xt*(tf)]  *(tan  x3  - -  )j  «  0 

X1  r'f 


The  objective  function  is 


J  “  1  -  PK<tf> 


(4-2) 


(4-3) 


(4-4) 
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where 


so  that 


where 


P 


K 


$[x<tf)]  - 


p  *  5000  +'  x^ccs  X4  +  X2Sin  x^ 
q  “  ~xj_stn  +  X2Coa 


(4-5) 


(4-6) 


(4-7) 

(4-8) 


and  'a' 


is  the  semi-  minor  axis  of 

PK  "  1 


a  given.  contour  such  that 


3(106) 


(4-9) 


The  evader's  heading,  can  arbitrarily  be  specified  as  zero* 
since  only  relative  heading  is  of  importance.  Then,  applying  condition 
(3-9) 

1-  (x,  +  5000)  +  viL  (4-10) 
_  2  ^.2 


x2  _  v 
2a2  xt 

2 

v  sec^  X3 
(3xx  +  20,000) 

2a2 

and  hence 

H(tf)  -  [  —  (x^  +  5000)  +  v  (Vpcos  X3  -  Ve)  + 
a2  xx2 


<  * : L_  -  — 

2a^ 

(3Xj  + 


\  \7  c  (n  -A*  m  oor  ^  n  4> 

'  *  -  - -  “J  .  ~"P  ■ 

VP 


-0,000)  rL.  ue]| 

2a2  V  f 


(4-11) 
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Now,  condition  <3-11)  requires  that  H(tf)  *  0,  so  that  setting  Eq  (4-11) 
equal  to  zero  will  yield  a  set  of  admissible  end  points  for  given  VI,,  V_, 
w,  a.  Up  and  ue.  Vp  and  Ve  may  be  arbitrarily  specified,  as  nay  a,  which 
defines  the  P^  contour  of  interest.  The  controls  Up(tf)  and  ue(tf)  are. 
selected  as  those  which  minimize  and  maximize  K  respectively.  *2  and  X3 
are  eliminated  from  Eq  (4-11)  by  using  Eqs  (4-3)  and  (4-5).  Eq  (4-11) 
is  now  reduced  to  a  function  of  and  v.  Parameterizing  in  v,  the 
equation  may  be  solved  numerically  to  yiald  the  condition  H(tj-)  *  0  and 
specify  x(tf)  and  A.(t f)  for  a  given  value  of  PK  and  v. 

Variable  Velocity  Model ■  It  is  interesting  to  note  that  the  end 
points  determined  in  the  precading  section  are  also  those  for  the  variable 
velocity  game  model.  Since  4>  and  x  ate  independent  of  Vp  ajid  Vc,  lj(tj) 

and  A^(t£)  are.  zero.  Thus  equation  (4-10)  is  independent  of  the  equations 

•  * 

defining  Vp  and  V£  and  its  solution  yields  valid  end  points  for  both 
game  models. 

The  Classical  SUP 

A  classical  BUP  In  the  Isaacs  sense  can  be  shown  to  exist  by  consid¬ 
ering  only  the  boresight  condition  in  Eq  (4-31.  Applying  conditions 
(3-13)  through  (3-15)  yields 

*2X^005  -  x2x6  -  xjx5s*n  x3  +  ~  *  0  (4-12) 

*5 

Eliminating  X3  from  (4-12)  using  Eq  (4-3)  gives 

*12  +  x22  -  x2  C  )  -  0  (4-13) 

x  /  i  gup 

It  can  be  seen  that  Eq  (4-13)  is  the  equation  of  a  circular  BUP 
cantered  on  the  X2~axis,  and  which  is  dependent  upen  u.p,  the  pursuer's 
control  (or  available  race  of  turn).  Physically,  the  circle  encloses 

•in 
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those  points  in  the  state  space  where  the  pursuer  cannot  hold  boresight 
on  E  because  of  his  turn  rate  limitation. 

This  BUP  does  not  have  any  great  practical  significance  in  the  prob¬ 
lem  considered,  since  the  Pjj  regions  are  not  intersected  by  the  regions 
defined  by  Eq  (4-13)  for  the  game  situations  considered  in  this  paper. 

The  chief  reason  for  making  the  foregoing  observations  is  to  provide  the 
contrast  between  the  classical  analysis  and  the  solution  method  developed 
here. 

The  Terminal  Conditions 

A  typical  set  of  solutions  satisfying  the  terminal  conditions  are 
shown  in  figures  4  and  5  overleaf  for  V  of  850  ft/sec  and  V  of  780 

r  ^ 

# 

ft/sec.  Each  value  of  v  affords  one  end  point  for  any  given  value  of 
P^.  Hence,  each  value  of  V  results  in  a  locus  of  end  points  which  is 
symmetrical  about  the  x-^-axis.  Only  the  solutions  for  the  positive  values 
of  X2  are  shown.  Several  observations  can  now  be  made  about  the  ad- 
missable  end  points  and  their  effects  on  solution  trajectories. 

End  Point  Envelope.  Figures  4  and  5  show  that  the  solution  end 
points  are  contained  in  an  "envelope"  bounded  by  the  locus  of  end  points 
for  v  ■  0.  This  is  typical  of  the  solutions  for  any  values  of  Vp  and  Ve 
at  the  terminal  time,  provided  Vp  >  Ve.  Numerically,  however,  Eq  (4-11) 
in  certain  cases  gives  rise  to  end  points  not  contained  in  the  v  «  0 
envelope.  These  end  points  are  considered  invalid,  since  it  is  readily 
shown  that  P,  having  once  attained  boresight,  can  hold  boresight  with 
increasing  until  the  v  •*  0  locus  is  reached.  In  essence,  the  dynamic 
equations  are  integrated  forward  in  time.  E's  control  ic  optimal  and  P's 
:outrol  is  that  required  to  hold  boresight  on  E;  the  Pj.  is  shown  to  in¬ 
crease  until  the  v  *  0  locus  is  reached.  The  spurious  end  points  are 
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discarded  on  the  basis  of  this  reasoning. 

Evader  Control  (ue) .  The  evader's  control  at  the  final  time  is 
influenced  by  X4(t£).  Considering  only  the  half  plane  for  X2  >  0,  the 
value  of  ue*(tf)  is  that  which  maximizes  H(t£).  Now,  from  Eq  (4-10) 

X4(tf)  -  (3Xl  +  20,000)  (4-14) 

2a2 

and  the  term  in  H  containing  ue  is 

X,(t£)i4(tf)  -  (3x  +  20,000)  «  (4-15) 

2a2  Ve  6 

Thus 

ue*(tf)  uemaySgn(X4(tf>>  (4-16) 

Pursuer  Control  (up) .  By  similar  reasoning  to  the  previous  sub¬ 
section,  it  can  be  shown  that 


Up*(t£)  ■  —  UpjgjjjCSgn(X^(t£) ) 

Thus  Up*(t£)  is  entirely  dependent  on  the  sign  of  v. 


(4-17) 


Summary 

The  solution  '>iethod  developed  in  this  chapter  permits  the  specifi¬ 


cation  of  terminal  conditions  for  any  given  set  of  problem  parameters. 
Numerical  backward  integration  techniques  may  now  be  used  to  obtain  op¬ 
timal  trajectories  from  any  of  the  given  terminal  conditions. 
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V.  Analysis  of  the  Constant  Velocity  Model 

The  admissable  sets  of  terminal  conditions  for  the  pursuit-evasion 
game  can  now  be  specified  using  the  method  developed  in  Chapter  IV,  The 
purpose  of  this  chapter  is  to  consider  the  generation  of  PK  barriers  for 
the  constant  velocity  node.l  by  analyzing  optimal  trajectories  obtained 
by  backward  integration. 

Mathematical  Statement 

The  state  equations  of  motion  are 


X1  -  VpCOS  x3 

Xj  ■  V^sin  x3 

•  8 

X3  " - UT) 

J  V  P 
P 


Vecos  X4 


Vesin  x4 


8 


(5-1) 


u« 


I  ■ 


I  : 


The  costate  differential  equations  are 


X1  *  0 

x2  -  0 


x3  "*  Vp(X^sin  X3  -  X2cos  X3) 
X^  *  Ve(-XiSin  x4  +•  XjCos  x^) 


(5-2) 


The  objective  function  i3 


J<tf)  -  iL 


P2  +  o2 


4a2  Cf 


(5-3) 


where  p  and  q  are  defined  by  Eqs  (4-7)  and  (4-8),  and  the  terminal 
constraint  at  tf  is 

tan  xa  -  ^2.  “  0  (5-4) 


- 


.  B-.*«asa#Si^»Sv»r«r- 
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The  transversality  conditions  then  yield  X(tf)  snd  H(tj)  as  defined  by 
Eqs  (4-10)  and  (4-11).  The  controls  which  minimize  and  maximize  H  are, 
respectively 

“p*  ’  'upmaxsSn(x3>  <5~5> 

ue*  “  W^(V  (5~6) 

The  end  point  for  a  given  set  q<£  parameters  is  determined,  and  backward 
integration  of  Eqs  (5-1)  and  (5-2)  then  yields  an  optimal  trajectory. 

Singular  Arcs.  Application  of  the  necessary  conditions  summarized 
in  Appendix  B  give  Che  following  set  of  equations  which  must  be  satisfied 
if  a  singular  arc  is  to  exist  for  the  pursuer: 


«  0 

VP 

9 

(5-7) 

h  -  o 

(5-8) 

X^sin  X3  -  X2C03  X3  -  0 

(5-9) 

tan  x->  “  --2- 
*1 

(5-10) 

The  optimal  control  on  the  singular  arc  is 

up*  -  0  (5-11) 

Control  Sequences.  The  controls  yielded  by  Eqs  (5-5)  and  (5-6)  are 
physically  equivalent  to  P  and  E  flying,  maximum  rate  turns.  Where  singu¬ 
lar  arcs  exist,  Eq  (5-11)  indicates  that  P  flies  a  straight,  level  "dash." 
These  control  sequences  are  typical  for  the  case  where  Che  controls  appear 
linearly  in  the  state  equations,  since  no  continuous  nonotomlc  changes 
in  control  can  occur.  This  is  a  direct  result  of  applying  the  necessary 
conditions  for  a  mirimax  solution. 

Trajectory  Analysis 

There  is  no  known  precedent  which  would  indicate  a  standard  procedure 
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for  determining  partition  trajectories.  Thus,  initially,  a  number  of 
trajectories  were  obtained  by  numerical  backward  Integration  and  their 
characteristics  analyzed.  These  trajectories  are  considered  in  a  coordinate 
frame  relative  to  the  evader  which  is  centered  at  the  «■  1  point  and 
rotates  with  the  evader.  The  transformation  to  the  p-q  coordinate  frame 
is  accomplished  by  applying  Eqs  (4-7)  and  (4-8). 

In  the  subsequent  analysis,  the  game  parameters  are 

Vp  -  850  ft/sec 
Ve  »  780  ft/sec 
a  *  2000  ft 
v  variable 

Thus  P's  objective  is  to  reach  a  region  where  _>  5/9  with' bore-sight , 
and  E  attempts  to  prevent  this  termination.  Computation  of  a  possible 
end  point  is  equivalent  to  assuming  termination,  and  backward  integra¬ 
tion  then  yields  the  paths  and  strategies  which  would  result  in  the  given 
ending  for  a  free  time  differential  game. 

Figure  6  (Page  27)  shows  a  typical  trajectory  depicted  in  the  p-q 
frame.  P’s  heading  at  various  points  is  show  by  the  arrows.  The  first 
consideration  concerns  the  juxtaposition  of  P  and  E  at  the  point  labelled 
"A".  Assume  that  the  game  were  to  commence  at  this  point,  and  consider 
P's  velocity  in  relation  to  the  velocity  of  C  (Vc)  as  shown  in  Figure  7 
overleaf. 

/ 

It  is  heuristically  obvious  that  E's  best  strategy  at  this  point 
would  be  a  turn  to  the  right,  thus  moving  C  away  from  P.  Vc  is  a  combina¬ 
tion  of  Ve  and  the  angular  velocity  due  t:o  E's  turn  rate  (X4).  The  velocity 
Vc  is  greater  than  Vp,  and  hence  E  could  prevent  P  from  reaching  C  and 
terminating  at  the  specified  end  point.  The  deduction  made  from  this 
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Figure  7.  Comparison  of  VD  and  Ve 

reasoning  is  that,  at  some  point,  the  trajectory  in  Figure  6  has  crossed 
a  singular  surface;  specifically,  a  dispersal  surface.  This  invalidates 
a  portion  of  the  trajectory.  The  questio'  v?hJ.ch  then  arises  is  how  to 
identify  and  locate  the  dispersal  surface. 

The  Dispersal  Surface .  From  Chapter  III,  the  major  reouirements  for 
a  dispersal  surface  are: 

(»',  Intersection  of  paths  of  different  classes. 

(b)  At  intersection,  the  states  must  be  identical. 

(c)  The  payoff  at  termination  is  the  same  for  each  path. 

Reconsidering  Figure  6,  it  C3n  be  observed  that  for  each  end  point 

on  the  positive  q  half-frame,  there  is  a  "mirror  image"  end  point  in  the 
negative  half-plane.  Thus  the  end  points  are  symmetrical  about  the  p-auis f 
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as  are  the  resulting  optima),  trajectories.  A  direct,  outcome  of  this  ob¬ 
servation  is  that  symmetrical  trajectories  intersect  on  the  p-axis,  Hence 
the  requirements  at  (a)  and  (c)  are  fulfilled,  the  payoff  for  the  present 
example  being  a  Pj£  of  5/9  at  tf. 

Considering  requirement  (b) ,  it  is  seen  that,  at  the  intersection  of 
symmetrical  trajectories,  the  positional  states  p  and  q  are  equal  for 
coincidence.  However,  the  relative  heading  state  (X3-X4)  is  r.ot  the  same 
for  both  trajectories.  Although  the  magnitudes  are  equal,  the  directions 
are  not.  In  only  one  case  can  coincidence  of  all  three  states  be  obtained 
for  symmetrical  trajectories  and  that  occurs  for  (i.e.,  co-heading) 

at  intersection  on  the  p-axis.  If  two  such  symmetrical  trajectories  can 
lo  be  found,  then  at  least  one  point  on  the  dispersal  surface  can  be  identified. 

The  trajectory  analysis  reveals  that  the  end  points  defined  for  v<0 
result  in  trajectories  that  contain  a  switch  of  tip  from  +Upma>;  to  -Upmax, 

This  is  a  direct  consequence  of  X3  passing  through  zero  at  some  point  in 
the  trajectory.  Further  study  shows  that  for  some  value  of  v<0  the 
conditions  .;iven  by  Eos  (5-8)  through  (5-10)  are  satisfied,  and  hence  that 
a  singular  arc  exists.  In  all  the  cases  studied,  this  singular  arc  provides 
a  means  of  obtaining  the  previously  discussed  point  on  the  dispersal  surface. 

Singular  Arc  Traj ectories.  The  satisfaction  of  the  necessary  condi¬ 
tions  for  a  singular  arc  essentially  devolves  into  a  one  parameter  search 
over  the  values  of  v<0.  Only  one  value  of  v  results  in  the  satisfaction 
of  the  junction  conditions  for  a  singular  arc  for  a  given  value  of  Vp, 

Ve  and  Pg(tf).  Once  the  conditions  (5-7)  through  (5-10)  are  reached,  r's 
control  is  switched  to  the  optimal,  value  of  zero  (F.q  (5-11)).  Backward 
integration  continues,  ar.d  optimality  of  the  resulting  paths  Is  maintained. 

A  further  characteristic  of  the  singular  arc  is  that  Up  may  be 
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switched  arbitrarily  to  +Upmax  at  any  time  on  the  arc  while  retaining 
optimality.  The  major  importance  of  the  singular  arc  is  that  it  results 
in  an  infinite  number  of  trajectories.  By  judicious  manipulation  of  the 
time  at  which  P’s  control  is  switched,  once  01.  the  singular  arc,  a  trajec¬ 
tory  can  be  obtained  which  intersects  the  p  axis  in  such  a  way  that  the 
relative  heading  (X3-X4)  is  zero  at  the  point  of  intersection.  By  the 
previous  reasoning,  this  point  is  on  a  dispersal  surface,  and  the  trajec¬ 
tories  which  produce  it  can  be  terminated  at  the  point  of  intersection. 

Partitions  of  the  Game  Space 

The  foregoing  section  discussed  the  construction  of  optimal  trajec¬ 
tories  and  the  presence  of  a  dispersal  surface.  A  method  was  also  devel- 
oped  whereby  at  least  one  point  on  this  surface  may  be  defined.  Two 
factors  now  require  consideration: 

(a)  Whether  the  game  space  is  in  any  way  partitioned. 

(b)  If  partition  is  shown  to  exist,  how  it  can  be  diagrammaticallv 
represented. 

The  Existence  Partitions.  Observation  of  the  behavior  of  many 
optimal  trajectories  for  -3.0  _<  v  <  0.4  indicates  that  the  point  (x^g) 
identified  as  being  on  the  dispersal  surface  bounds  the  values  of  p  at 
which  all  other  trajectories  intersect  the  p-axis.  The  typical  case  is 
illustrated  in  Figure  S  overleaf  by  several  example  trajectories.  From  a 
heuristic  standpoint,  the  above  observation  makes  sense,  since  the  point 
xps  (Fig  8)  includes  the  most  advantageous  heading  for  P  on  the  negative 
p-axis.  Hence,  it  could  be  concluded  that,  from  a  starting  point  at  which 
3c-*-x/,  -  0.  P  can  achieve  a  P^(tf)  «  5/9  from  the  least  advantageous  point 
on  the  negative,  p-axis,  i.e,,  the  point  furthest  from  C.  The  question  is 
whether  this  bound  can  be  established  mathematically. 
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The  Definition  of  Partion.  A  linear  perturbation  analysis  is  devel¬ 
oped  in  Appendix  C  which  is  used  to  show  that  includes  the  least  value 
that  p  can  assume  for  termination  at  Ps.(r.f)  «  5/9.  Effectively,  the 
costate  values  X(t)  can  be  regarded  as  influence  coefficients  on  the  payor 
function  J,  where 

J  »  <J>(x)  +  vX(x)  (5-12) 

tf 

If  Xjjg  is  defined  as  the  starting  point  for  the  game  at  time  t  ■  tQ,  then 
It  can  be  shown  that 

AJ  «  A?  (tQ) Ax(tQ)  (5-13) 

Thus  the  effect  of  small  perturbations  Ax(tc)  on  J  can  be  investigated 
for  Xyg  by  considering  the  sign  of  AJ.  Further,  assuming  bore-sight  at 
t£,  X(x(tf))  *  0  and  thus 

J  -  $(x(tf)>  (5-14) 

Since  $  -  (frcm  Ed  (4-4)),  it  follows  that  a  positive  AJ  represents 

a  reduction  in  Pj^tf). 

Table  1  below  shows  the  approximate  values  of  X(tQ)  for  the  two 
trajectories  which  Intersect  to  give  the  point  xDg. 

Table  I 

Values  of  Xj,s(t0)  at  XpS 

Trajectory  1  Trajectory  2 

<q(t£)  >  0)  <9 (tf )  <  C) 

X1(t0)  -.00046  -.00046 

X2(to)  +.00044  +.00044 

X3(t0)  +.00001  -.00001 

Thi'ee  observations  may  be  marie  about  the  behavior  of  AJ  due  to  arbitrary 
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Ax(t0) : 

{a)  Negative  Ax^  always  result  in  a  reduction  in  PK(t£)  for  constant 
$2  and  X3.  Thus,  by  definition,  E  escapes. 

(b)  Positive  Ax^  always  results  in  an  increase  in  L.e., 

P  captures. 

(c)  Either  +  A«2  or  +  Ax^  result  in  a  reduction  in  P^(t^)  for  the 
two  trajectories,  thus  relieving  E  of  his  dilemma  over  choice  of  strategy 
at  t0,  and  enabling  escape. 

The  conclusion  made  is  that  the  point  xng  is  one  bound  for  the  starting 
points  on  the  p-axis  from  which  a  Pj<(tf)  *  5/9  can  be  achieved.  As  such, 

Xjjg  provides  a  partition  of  the  game  space. 

Obviously,  the  starting  points  discussed  above  are  also  bounded  at 
some  point  on  the  positive  p-axis.  Physical  argument  indicates  that  this 
point  is  the  point  on  the  axis  where  P%  •  5/9  and  P  is  boresighted  on  E. 

This  point  is  labelled  XpB  in  Figure  8.  It  is  readily  deduced  from  the 
dynamics  of  the  game  that  P  cannot  capture  from  a  point  nearer  to  E  on 
the  p-axis  than  Xpg. 

The.  overall  conclusion  made  is  that,  at  least  for  starting  points 
on  the  p-axis,  the  game  space  can  be  partitioned  into  sets  of  points  which 
represent  escape  and  capture  regions. 

Partition  Diagrams 

The  optimal  trajectories  developed  for  the  constant  velocity  model 
are  3-dimensional,  the  variables  being  the  two  position  coordinates  and 
the  relative  heading.  This  raises  the  problem  of  presentation.  Two 
methods  appear  to  be  available: 

(a)  Projection  of  the  trajectories  on  to  one  plane  of  the  space. 

(b)  Parameterization  of  one  of  the  variables. 
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Both  of  the  possibilities  offer  advantages.  Using  one  variable  as  a 
parameter  allows  the  neutral  starting  points  to  be  represented  as  a  two 
dimensional  curve  enclosing  the  capture  sp^ce.  Projection  permits  the 
capture  space  to  be  diagrammed  as  bounds  on  two  of  the  variables.  Both 
methods  are  considered. 

The  Parameter  Method.  Partition  of  the  values  of  p  has  been  shown 
for  those  starting  points  on  the  axis  co-linear  with  (the  p~axis). 
Effectively,  this  represents  a  parameterization  in  q  for  qM0.  Charac¬ 
teristically,  each  optimal  trajectory  obtained  for  the  game  intersects 
the  p-axis  (q«*0)  at  particular  values  of  p  and  (x^-x/,).  The  perturbation 
analysis  previously  developed  can  be  used  to  show  that  the  relative 
heading  at  intersection  is  critical,  and  thus  represents  a  bound  on  the 
pursuer’s  heading  for  termination  at  *  5/9.  For  q«0,  the  game 

space  can  thus  be  divided  into  escape  and  capture  regions  as  shown  in 
Figure  9  overleaf. 

The  Projection  Method.  The  obvious  plane  on  which  to  protect  the 
capture  region  is  the  p-q  plane,  since  this  represents  a  simple  physical 
interpretation.  To  fully  define  the  capture/escape  regions,  the  pro¬ 
jections  would  enclose  all  the  positions  (p,q)  from  which  P  could  attain 
capture  given  chat  his  heading  was  sufficiently  advantageous.  The  bound 
on  the  region  would  be  those  points  where  P  had  the  most  advantageous 
heading  and  could  achieve  a  maximum  P^(tf)  of  5/9. 

The  methods  developed  here  do  not  include  a  simple  way  of  obtaining 
a  complete  partition  of  the  game  space.  Each  value  of  relative  heading 
requires  consideration  and  the  bound  on  position  must  be  established  for 
each.  So  far,  it  appears  that  this  can  only  be  achieved  by  a  long  and 
tedious  analysis  of  the  optimal  trajectories  obtained  from  all  adnissable 
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end  points. 

However,  it:  seems  frotn  the  results  obtained  that  a  reasonable 
approximation  can  be  made.  Analysis  of  the  available  trajectories  re¬ 
veals  that  the  singular  arc  trajectory  "enclos.s"  (in  the  positional 
sense)  all  other  trajectories  except  those  resulting  from  a  switch  in 
Up  on  the  singular  arc  itself.  An  approximate  partition  made  on  this 
basis  is  shown  in  Figure  10.  The  escape  region  could  be  considered  as 
the  positions  from  which  P  cannot  capture  regardless  of  heading.  It 
should  be  remarked  that  this  partition  is  not  mathematically  justified, 
but  represents  the  author's  interpretation  of  the  optimal  trajectories 
studied. 

0 

Summary 

This  chapter  contains  the  major  part  of  the  analysis  of  the  problem 
of  defining  the  escape  and  capture  regions  for  the  pursuit-evasion  pame 
studied.  The  analysis  was  achieved  by  a  largely  experimental  means,  that 
is,  by  physical  examination  of  the  optimal  trajectories  generated. 
Mathematical  deduction  enabled  specific  definition  in  some  cases,  but  in 
general  no  compact  analytical  method  could  be  developed.  However,  there 
appears  to  be  sufficient  evidence  to  suggest  that  the  game  space  for  this 
class  of  game  can  be  partitioned  into  escape  and  capture  regions. 
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VI.  Analysis  of  the  Variable  Velocity  Model 

Chapter  V  dealt  with  the  major  part  of.  the  analysis  done  on  the 
pursuit-evasion  problem  treated  in  the  thesis.  A  certain  amount  of 
effort  was  expended  on  the  variable  velocity  model,  and  the  purpose  of 
this  chapter  is  to  show  the  formulation  and  discuss  the  solutions  obtained. 

Mathematical  Statement 

The  state  and  costate  differential  equations  are 
*1  *  X5COS  X3  -  X6COS  X4 
*2  ■  xjsin  X3  -  x^sin  X4 


*3  “-"P 


(6-1) 


x-  “ 


A  -  - 

*6 


x5  -  Aj  +  AjXg  +•  + 


2  4.  2  x  i\  x  AA  2  j.  ^2 


2  <«p  +  «  +  -h  <V  + 

x5  x5 


x6  “  A1  +  A2.x6 


+  A^x^ 2  +  ^4 —  'u  2  +  1)  +  ^5 _ (u  2  +  1)2 

J  '  2  e  6  e 


x6 


x6 


A1 

*2 

X 


0 

U 


3  *>  x^d^sin  x3  -  X2cos  x3) 


Xg(-X^sin  +  X2C0S  *4) 


(6-2) 


X5  -  -A^cos  x3  -  X2sln  x3  +  Xj  u  -  XC[A2  +  2A3x^ 


x3 


_  9 


A4  2  A  „  _  6a5  2  x  1  \2 1 


-3  v-p 


7  ^ 
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Xg  ■  Xicos  X4  ■>  X2Sin  X4  +  X4  * — -  ue  -  Xg[A2  +  2a3xg 

*62 


-  2A4  («j  2  +  1)  _  6A 5.  (  2  +  i)2j 


When  the  optical  controls  are  interior  to  the  control  constraints,  then 
for  the  minimax  value  of  H  it  is  necessary  that: 


E*  ■  0  and  H*  ■“  0 
P  e 


(6-3) 


Application  of  these  conditions  gives  the  two  equations: 

3  A4Xcit  As  g  Xc5 

V  +  (  +  1)  un  -  -i - 2_  -  0 


2A5 


3  .  A4*64 

U  +  V 

e 

2AS 


-- +  1)  ue  - 


X5  4Aj 

x6  4A5 


(6-4) 


(6-5) 


Examination  of  the  coefficients  of  Eqs  (6-4)  and  (6-5)  shows  that  the 
equations  have  one  real  root.  Numerical  solution  yields  up  and  ue  . 

The  minimax  value  of  H  may  be  verified  by  the  sufficient  conditions: 

* 


H' 


>  0  and  H 


<  0 


(6-6) 


°P  "p 

If  the  optimal  controls  are  on  the  respective  constraint  boundaries, 
then  the  minituax  of  H  is  obtained  by  the  direct  application  of  Eq  (3-7). 


Trajectory  Analysis 

To  enable  comparison  with  the  constant  velocity  results  the  same  end 
point  conditions  were  used,  i.e., 

*4 (tf )  -  0 

x5(t£)  ■  850  ft/sec 
x^(tf)  K  780  ft/sec 


v  variable 
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A  number  of  optimal  trajectories  were  obtained  and  subjected  to  a 
similar  analysis  to  that  used  in  the  constant  velocity  model.  The 
trajectories  obtained  behaved  in  very  much  the  same  manner  as  for  the 
previous  model.  However,  the  same  conclusions  are  difficult  to  draw 
because  of  the  introduction  of  variable  and  Xg  (Vp  and  Vfi)  which  adds 
two  dimensions  to  the  solution  trajectories.  These  are  now  5-dimensional, 
as  would  be  the  resulting  captiire/escape  regions  of  the  game  space. 

The  problem  introduced  by  the  added  dimensions  proved  insuperable. 

When  the  analysis  was  commenced,  it  was  hoped  that  the  aircraft  velocities 
on  the  solution  trajectories  would  remain  largely  constant.  This  did  not 
prove  to  be  the  case,  and  no  acceptable  method  could  be  found  of  handling 
the  added  dimensions  diagrammatically .  However,  some  general  conclusions 
can  be  made. 

Dispersal  Surfaces.  The  existence  of  a  dispersal  surface  for  the 
variable  velocity  model  can  be  demonstrated  by  similar  reasoning  to  that 
employed  previously  in  Chapter  V.  It  also  appears  from  observation  of 
the  solution  trajectories  that  the  point  on  the  dispersal  surface  on  the 
p-axis  provides  a  bound  on  starting  points  on  this  axis.  However,  even 
when  q  is  set  to  zero  in  this  way,  the  starting  points  from  intersections 
on  Che  p-axis  are  4-dimensior.al,  and  conseouently  difficult  to  represent 
by  diagrams. 

Capture/Escape  Regions .  The  trajectory  which  yields  the  point 
(xds)  on  the  dispersal  surface  also  appears  to  play  an  important  role  in 
defining  escape  and  capture  regions.  In  the  projection  on  the  n-q  plane, 
the  trajectory  yielding  xjjg  appears  to  "enclose"  most  of  the  trajectories 
which  have  the  required  ending.  It  does  rot,  as  such,  constitute  a 
mathematical  partition  of  the  game  space,  but  it  does  provide  an  indication 
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of  the  size  and  shape  of  the  projection  of  the  partition.  This  in  turn 
gives  an  indication  of  the  capability  of  the  pursuer  to  achieve  capture. 
Figure  11  overleaf  shows  the  trajectory  which  results  in  Xjjg  for  the  present 
case.  As  before,  the  position  coordinates  xj  and  X2  are  transformed  to 
the  p-q  frame  by  using  Eqs  (4-7)  and  (4-8), 

Summary 

The  results  achieved  for  the  variable  velocity  model  do  not  enable 
the  definition  of  escape  and  capture  regions  for  this  model.  However, 
some  contributions  are  made.  The  presence  of  the  dispersal  surface  is 
demonstrated,  and  the  trajectories  obtained  give  an  indication  of  the 
pursuer's  capability  against  a  maneuvering  opponent. 
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VII.  Discussion  of  Results 

The  purpose  of  this  chapter  Is  to  discuss  the  results  obtained, 
and  to  consider  some  of  the  possible  Implications  of  the  methods  developed 
in  the  thesis.  Also  considered  is  the  extent  to  which  the  thesis  objec¬ 
tives  were  achieved. 

Thesis  Objectives 

The  thesis  objectives  were  threefold: 

(a)  To  develop  a  method  of  defining  escape  and  capture  regions  for 
a  two  aircraft  pursuit-evasion  game. 

(b)  To  consider  the  dependence  of  these  regions  on  the  variables 

in  the  problem.  ' 

(c)  To  consider  the  impact  that  definition  of  the  regions  might, 
have  on  tactics  and  design. 

The  second  two  objectives  are,  of  course,  dependent  on  the  first;  these 
are  discussed  subsequently. 

It  Is  fslt  that  the  primary  objective  has  only  partially  been 
attained.  Partition  of  the  game  space  into  escape  and  capture  regions 
was  achieved  in  only  certain  cases  for  the  most  simple  model.  However, 
the  methods  developed  appear  to  offer  possibilities  to  future  researchers, 
and  represent  at  least  the  initial  steps  toward  complete  solution  of  the 
problem. 

Analysis  Methods 

The  methods  used  here  to  analyze  solution  trajectories  are  largely 
empirical.  That  is,  many  trajectories  were  generated  and  conclusions 
made  from  their  physical  behavior.  It  does  not  seem  that  any  concise 
analytical  method  exists  which  would  reduce  this  physical  effort.  A 
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second  major  problem,  previously  mentioned,  concerns  the  dimensions 
of  the  game  space  and  the  solution  trajectories.  The  inability  of 
conventional  graphical  techniques  to  handle  surfaces  of  4  or  more  dimen¬ 
sions  handicaps  ’"he  analysis  of  solutions.  Removal  of  this  restraint 
vould  also  ease  the  difficulties  encouutered  in  presentation  of  the 
solutions. 

The  most  basic  ingredient  of  the  methods  used  was  to  specify  the 
sets  of  admissable  end  points  for  the  differential  game.  While  this  re¬ 
sults  in  many  trajectories  which  may  be  tedious  to  analyze,  it  avoids 
the  necessity  of  solving  a  two  point  boundary  value  problem  (TPBVP).  The 
TPBVP  in  a  differential  game  can  be  extremely  difficult  to  solve  be¬ 
cause  of  the  iterative  nature  of  solution  methods.  Also,  the  solution 
provides  information  about  only  one  trajectory,  some  portions  of  which 
may  be  non-optimal  due  to  the  presence  of  singular  surfaces  in  the  game 
space.  In  contrast,  provided  admissable  end  points  can  be  specified, 
backward  integration  is  a  very  speedy  and  simple  method  of  obtaining  many 
solution  trajectories.  This  type  of  approach  may  well  have  applications 
iu  other  fields  of  optimal  control  and  differential  games. 

Variation  of  Game  Parameters 

Some  effort  was  made  to  evaluate  the  dependence  of  the  partitions 
of  the  space  on  the  game  parameters,  but  insufficient  analysis  was 
achieved  to  enable  specific  conclusions  to  be  made.  The  most  significant 
parameter  is  considered  to  be  the  distance  that  the  PK  region  is  from  E. 

At  maximum  load  factor  of  5,  E's  turn  rate  is  about  0.2  rads/sec,  which 
means  that  the  «*  1.0  point  has  an  angular  velocity  of  1000  ft/sec. 

This  single  factor  contributes  greatly  to  E's  ability  to  escape.  Reducing 
Ve  causes  E  to  be  lift-limited  in  flight  (Appendix  A);  at  the  velocity 
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used  in  illustration  (7d0  ft/sec)  E's  turn  rate  is  still  about  0.18  rads/ 
sec. 

Some  experiment  was  made  in  two  areas  for  the  constant  velocity 
model: 

(a)  Increasing  P's  velocity  advantage  over  E 

(b)  Arbitrarily  reducing  E's  turning  capability 

Both  these  variations  produced  results  analogous  to  the  case  analyzed 

in  Chapter  V  with  the  expected  increase  in  the  sizes  of  the  capture  regions. 

However,  beyond  a  certain  reduction  in  u  ,  the  behavior  of  the  solu- 

emax 

tions  changed.  The  envelope  of  admissable  end  points  reduces  in  size, 

and  no  singular  arc  trajectories  can  be  found.  In  addition,  those 

trajectories  examined  did  not  appear  to  enclose  the  capture  space  in  the 

same  manner  as  before.  The  value  of  u„  at  which  most  investigation 

"max 

was  done  was  equivalent  to  a  maximum  load  factor  of  2.5. 

Insufficient  investigation  was  achieved  to  allow  specific  conclusions, 
but  the  following  ob;  ervations  are  made: 

(a)  It  is  probable  that  solution  trajectories  are  non-unique;  that 
is,  two  or  more  trajectories  have  the  same  end  point.  The  analysis  of 
numerical  solutions  is  then  invalid. 

(h)  Consideration  of  solutions  for  low  values  of  PK  (e.g.,  PK  *  5/9) 
may  be  misleading  when  E's  turning  capability  is  drastically  reduced. 

This  is  because  P  may  be  able  to  excede  the  selected  PK(tf)  easily  from 
a  great  variety  of  "advantageous"  positions.  Solutions  with  a  low  value 
of  P]^(t f )  may  then  only  have  significance  if  they  arise  from  initial 
conditions  at  which  P  is  at  a  disadvantage  relative  to  E. 

Tactical  and  Design  Implications 

As  previously  stated,  the  simplicity  of  the  aircraft  models  used  in 
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the  thesis  limit  the  conclusions  that  may  be  drawn  about  real  air 
combat  situations.  However,  there  are  inferences  which  are  considered 
to  have  some  validity. 

The  most  obvious  conclusion  is  that  the  capture  regions  are  ex¬ 
tremely  small  for  two-dimensional  maneuver.  The  single  most  important 
factor  contributing  to  this  is  the  angular  velocity  which  the  Pj.,  regions 
move  as  a  result  of  the  evader's  turn  race.  In  reality,  however,  the 
situation  is  not  quite  as  adverse  as  it  appears,  since  current  analysis 
shows  that  the  pursuer  does  in  fact  have  some  opportunity  for  a  "side- 
shot."  That  is,  in  turning,  the  evader  opens  up  a  region  on  the 
inside  of  the  turn.  This  was  not  modeled  for  this  investigation,  and 
represents  an  area  where  further  fruitful  research  might  be.  accomplished. 

Also  it  is  difficult  to  logically  extend  the  results  of  this  in¬ 
vestigation  to  three  dimensions.  One  observation  is  that  the  results  ob¬ 
tained  here  are  valid  for  motion  in  any  plane  in  the  absence  of  gravity. 
An  inference  from  this  is  that  it  is  difficult  to  see  how  the  pursuer's 
capability  could  be  improved  in  three-dimensional  maneuver.  Specific 
results  in  this  area  are  once  again  subject  to  a  great  deal  more  re¬ 
search. 

From  the  tactical  view  point,  it  is  felt  that  there  is  sufficient 
evidence  from  this  research  to  indicate  severe  limitations  on  the  use  of 
this  particular  airborne  missile  system.  While  its  performance  against 
an  unsuspecting  target  may  be  adequate,  evasive  maneuvers  on  the  part  of 
the  evader  cause  a  great  reduction  in  the  pursuer's  capability. 

In  the  design  field,  the  approach  presented  here  is  felt  to  have 
considerable  potential.  This  potential  lies  not  only  in  evaluating  the 
capability  of  a  given  system,  but  also  in  the  comparison  of  different 
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weapons  systems.  Realization  of  the  potential  is  dependent  upon  several 
factors.  A  refinement  of  the  general  approach  developed  is  necessary, 
and  the  obstacle  of  graphically  displaying  multi-dimensional  surfaces 
must  be  overcome.  Of  the  two,  the  latter  presents  the  greatest  problem, 
and  solution  would  greatly  benefit  future  research. 

Summary 

In  general,  the  research  presented  here  has  met  with  limited  success 
in  relation  to  the  overall  objectives.  However,  several  original  solu¬ 
tion  methods  are  employed,  and  the  development  potential  offers  many 
opportunities  for  future  research. 
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VIII.  Conclusions  and  Recommendations 

Conclusions 

A  two  aircraft  pursuit-evasion  game  has  been  posed  a3  a  free  time, 
zero  sum,  perfect  information  differential  game.  A  method  of  determining 
admissable  end  points  to  the  game  was  developed,  permitting  the  use  of 
numerical  backward  integration  techniques  to  produce  optimal  trajectories. 

Two  aircraft  models  were  used,  in  both  of  which  motion  was  restricted 
to  level  flight  at  constant  altitude.  The  simpler  model  had  the  addition¬ 
al  restraint  that  both  aircraft  move  with  constant  velocity.  Examination 
of  the  optimal  trajectories  obtained  yielded  a  partition  of  the  game 
space  into  escape  and  capture  regions  under  certain  conditions  for  the 
simple  model.  Complete  partition  of  the  game  space  was  not  achieved  for 
either  model,  but  the  existence  of  partition  is  shown,  and  a  general 
approximation  made  within  the  limits  of  the  graphical  techniques  available. 

From  the  practical  standpoint,  it  can  be  concluded  that  a  weapon 
system  with  characteristics  similar  to  those  considered  in  the  present 
case  may  have  severe  limitations  when  faced  with  intelligent  opposition. 
Although  the  constraints  imposed  in  this  analysis  are  unrealistic  in  some 
senses,  there  is  sufficient  evidence  to  make  the  preceding  conclusion. 

In  terms  of  evaluating  the  capability  of  air-to-air  weapon  systems, 
the  methods  developed  here  are  considered  to  have  significant  potential; 
this  potential  is  dependent  upon  further  refinement  of  the  techniques 
employed. 

Recommendations 

The  methods  developed  in  this  thesis  represent  the  first  steps 
towards  an  analytical  solution  to  the  problem  of  defining  escape  and 
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capture  regions  for  aerial  pursuit-evasion  games.  The  greatest  hurdle 
encountered  was  the  graphical  limitations  on  presentation.  In  the 
event  that  further  research  is  attempted,  the  following  areas  are 
recommended : 

(a)  Refinement  and  generalization  of  the  analysis  of  optimal 
trajectories  generated  by  backward  integration. 

(b)  Determination  of  graphical  methods  for  demonstrating  multi¬ 
dimensional  surfaces  and  trajectories. 


CO 
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Appendix  A 

Development  of  the  Aircraft  Model 


Purpose 

The  purpose  of  this  appendix  is  to  show  the  development  of  the 
aircraft  dynamic  model  used  in  the  thesis.  The  model  is  generalized 
to  3  dimensions  and  then  specialized  to  the  final  planar  model  used. 

Aircraft  Dynamics 

The  model  is  based  upon  empirical  data  for  the  F4-E  published  in 
Reference  (4).  For  each  of  3  altitudes  analytic  functions  are  developed 
for  thrust  (T)  and  lift  limit.  The  coefficient  of  drag  (Cjj)  is  related 
analytically  to  lift  coefficient  (C^)  for  subsonic  flight  with  validity 
up  to  a  Mach  No  (M)  of  0.9. 

Thrust  (T) .  Both  aircraft  are  assumed  to  be  using  full  after¬ 
burner  thrust  during  combat.  Figure  12  overleaf  shows  the  variation 
of  thrust  with  velocity  and  altitude.  A  linear  approximation  to  the 
curves  over  the  velocity  range  of  interest  yields 

T  -  a  +  bh  +  cV  (A-l) 

where 

a  -  22,346.7  lb 
b  -  0.7018  lb/ft 
c  *  18.141  lb/ft/sec 

For  a  constant  altitude  of  20,000  ft.  the  relation  becomes 

T  -  8310.7  +  18.141V  (A-2) 

Lift  Limit .  The  maximum  lift  that  can  be  developed  for  a  given 


T  »v2scl™* 


velocity  is 


L 


(A-3) 
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and  load  factor  (n)  is  defined  as 

n  -  (A-4) 

W 

hence  the  maximum  load  factor  attainable  is 

%ax  “  *  ^Lmax  (A-5) 

2  W 

For  flight  regimes  where  n  is  not  limited  by  Eq  (A-5) ,  the  maximum 
value  of  n  is  taken  as  5.  This  represents  a  realistic  limit  imposed  by 
a  pilot's  capability  to  withstand  sustained  acceleration  forces.  Lift 
limited  load  factor  is  plotted  against  velocity  in  Figure  14  (Page  56) 
with  altitude  as  a  parameter.  A  linear  fit  gives 

ir  „  -  0.16  +  (0.G1422  -  .000304h)  (V  -  250)  <A~6) 

I&aX 

* 

For  planar  flight  at  20,000  ft 

tW,v  «  01.875  +  .00814V  (A-7) 

Drag  Coefficient.  CD  is  graphed  in  Figure  13  (Page  54)  as  a 
function  of  CL.  A  quartlc  curve  fit  is  made,  giving 

CD  '  CD0  +  h  V  +  k2Cl4  (A-8) 


where 


Cqo  *  0.0185 
kx  -  0.1007 
k2  -  0.3261 


Equations  of  Motion 

Figure  15  (Page  57)  shows  diagramatically  the  variables  used  to 
describe  the  aircraft  states  in  3  dimensions.  The  equations  of  motion 
mow  Kg  vrit  t -3r. 

x  *  VcosycosQ 

* 

y  ■■  Vcosysine 
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3b? 


h  ■  Vsiny 

e  m  gLs*n<fr 
WVcosy 

v  ■  £.  (  Lcps4l  —  cosy) 

V  w 

V  -  2.  (T  -  D) 

V 

Constant  altitude  flight  requires  that 


and  hence 


thus 


Lcostfi  *  W 


n  ■  k  ■  -A  - 

W  cos$ 


ain$  -  +  I  (n2-!)1^2 
~  n 


If  the  control,  u,  is  defined  by 

u  -  +  (n2-i) 

then  for  constant  altitude  flight,  Eq  (A-9)  can  be  written 

x  ■  Vcos0 
y  •  Vsin0 

0  -  *-u- 
V 

V  -  I  (T  -  D) 

W 

The  limits  on  u  such  that 


u  .  <  u  <  u 

min  —  -■  max 


are  imposed  by  the  lir.its  on  load  factor  n. 
The  dray,  is  given  bv 


0  "  \  »v2s<cno  +  hcL2  +  Vi.4) 


(A-9) 

(A-10) 

(A-ll) 

(A-12) 

(A-13) 

(A-.14) 

(A-15) 

(A-.l  5) 
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and 


thus 


where 


c  «  — k - 

1  pV2S 

2 

(A-l 7 ) 

+  A,  <ui+l)  + 

A5(u2+1) 2 

(A-18) 

T  A4  o 

Vz 

V6 

A3‘  *  i-  pSCj^o 

(A~19) 

a4  -  ^“1 

pS 

(A-20) 

2k2w‘ 

Ac  “  _ 

(A-21) 

PS 


From  Eq  (A-2) ,  thrust  can  be  written 


T  -  Ax  +  A2V 

Using  Eqs  (A-lbJ  and  (A-22) ,  equations  of  motion  become 

X  *  Vcos6 
y  ■  Vsin0 

ft  -  £1 


(A-22) 


.  A4<u^+1)  A5(u^+X) 

V  -  A,  +  AoV  +  A-V2  +  — - -  +  — i - 

i  l  J  j  f, 

vb 


(A-23) 


For  constant  velocity  flight  V  -  0. 
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Appendix  B 

The  Necessary  and  Junction  Conditions 
for  Singular  Arcs 


Purpose 

The  purpose  of  this  appendix  is  to  summarize  the  necessary  and 
junction  conditions  for  singular  arcs  in  the  optimal  solutions  to  a 
differential  game  where  the  players'  controls  appear  linearly  in  the 
Hamiltonian.  The  summary  is  based  upon  the  derivation  developed  in 
Ref  (1). 


Problem  Formulation 

The  state  equations  are 

i  **  f(x,u,v)  (B-l) 

and  f^  is  linear  in  u  and  v.  The  Hamiltonian  (H)  is 

H  -  XTf  (B-2) 

where  x  is  tha  n-dimensional  scat?  vector,  and  _X  the  n-dimensional  co- 
atate  vector,  subject  to 

k  "  ‘  H-x  (B~3) 

The  terminal  values  x(tf)  and  Htf)  are  assumed  specified. 

A  payoff  function  J  is  specified  and  the  objective  of  the  game  is 
to  find  u*  and  v*  Cor  the  saddle  point  solution 


min  max  J  (u*„  v*)  »  max  min  J  (u*,  v*)  (B-4) 

u  v  v  u 

over  the  time  internal  [rn,  t^J.  The  controls  u  and  v  are  subject  to 
the  constraints 


ui 


<  u 

-•  max 


<  v 

—  max 


(B-5) 
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J 


Necessary  Conditions 

For  a  saddle  point  solution  in  J,  a  saddle  point  in  H  is  necessary- 
such  that 

min  max  H  «  max  min  H  (B-6) 

U  V  V  u 

If  switching  functions  Su  and  Sy  are  defined  such  that 

Su<x,A)  “  f~  <B-7) 

Sv(x,X)  -  (B-8) 

v - 3V 

then  the  saddle  point  controls  are  given  by 


u 

u 

V 

V 


“max 

if 

umln 

if 

vmax 

if 

vmin 

if 

<  0 
>  0 

>  0 
<  0 


(B-9) 


(E-10) 


Singular  Solutions 

Due  to  the  linearity  in  u  and  v,  the  Hamiltonian  may  be  written 


H  -  AT  £(£>  +  Su  u  +  Sy  v  (B-ll) 

Assume  that  Su  «  0,  so  that  H  becomes  independent  of  u;  thus  minimization 
of  H  with  respect  to  u  is  not  possible. 

Necessary  and  Junction  Conditions.  It  can  be  shown  that  along  a 
singular  arc,  in  general 

Su(x,X)  -  Su(x,X)  -  .  .  .  .  Su(2q_1)(x,A)  -  0  (B-12) 


where  'successive  differentiation  yields  a  function  uhich  is  explicit  in  u 


(?-q) 


(x, \ ,u)  -  0 


(B-14) 
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Eq  (B~14)  stay  be  solved  to  yield  the  minimizing  u*  on  the  singular  arc, 
and  Eqs  (B-13)  must  hold  across  the  junctions  between  singular  and  non~ 
singular  arcs. 

One  further  necessary  condition  is  that 

—  [Su(2q)J  <  0  (B— 15) 

3u 


where  q  is  odd. 
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Appendix  C 

Development  of  Influence  Functions 
for  _a  Differential  Game 

Purpose 

The  purpose  of  this  appendix  is  to  show  how  the  costates  (X_(t)>  can 
be  used  as  influence  functions  to  determine  the  effect  of  small  perturba¬ 
tions  (Ax(t)}  on  an  optimal  trajectory  for  a  class  of  differential  games. 

Mathematical  Development 

A  differential  game  is  assumed  with  augmented  objective  function 

J  -  4>(x(tf))  +  \>x(£<tf>)  (C-l) 

subject  to  the  differential  constraints  ' 

.4  “  J[(x»u*v)  (C-2) 

where  the  controls,  u  and  v  arc  bounded  by 

“min  1  u  1  “max  <C-3) 

v  .  <  v  <  v  (C-A) 

min  —  —  max  v  ' 

The  Hamiltonian,  Ii  i3  formed  such  that 

H  -  X.Tf  (C-5) 

whence,  application  of  the  accessary  conditions  for  optimality  yields 

X  «  -  f!  A  (C-6) 

with  the  end  conditions 

A(tf)  -  Jx  (C-7) 

making  a  first  order  expansion  of  Eqs  (C-2)  and  (C-6)  at  some  time,  t 

Ax  -  Ax  +•  f  Au  +  f  Av  (C-f) 

—  —X  —  u  ~v  x  ' 
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AX  -  -  f*  AX  (C-9) 

Combining  Eqs  (C-8)  and  (C-9) 

XT  Lx  +  XT  Lx  -  XT (fT  Lx)  +  XTf  Au  +  XTf  Av  (C-10) 

~  ~  ~  ~x  ~  - 11  - V 

-  (XTfx)Ax 

-  XTfAu  +  XTf  Av 
- jli  - v 

On  an  optimal  trajectory,  the  necessary  conditions  following  must  be 
satisfied  If  u  and  v  are  unconstrained 


Hu-0,  Hv  -  0 

Hence  from  Eq  (C-5) 

"  0  .  lv  “  0 

If  u  and  v  are  on  the  constraint  boundaries  then 


Au  “  0  ,  Av  •  0 

Using  Eqs  (C-12)  and  (C-13)  in  Eq  (C-10) ,  then 

AT  Ax  +  XT  Ax  «  0 

and  hence 

t  «  •  *r  f  f  J  t 

/  (XlAx  +  X1 Ax)dt  -  /  (xiAx)]dt  «  0 

■*”  rl  f* 


'A1  A?)  1 1  -  (X1  Ax)  |  -  0 

f 


*  (_XTAx)  |  ■  (ij Ax)  | 

Cf  co 


Now,  from  Eq  (C~l) 

A.T  «»  AT  Ax')  I 
'  r  — '  1  t 
-  f 

Thus,  combining  Eqs  (C-7)  and  (C-18) 

&J  *  (  aT  Ax)  | 

cf 


(C-ll) 

(C-12) 

(C-13) 

(C-14) 

(C-15) 

(C-16) 

(C-17) 

ff.-lft) 

(C-19) 
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The  Implication  of  Eqs  (017)  and  (019)  is  that 

AJ  -  (XT  Ax)  |  (020) 

o 

Thus,  it  can  be  shown  that  the  coatates  at  tQ  (X.(t{^)are  influence 
coefficients  on  AJ  at  allowing  the  determination  of  the  effects  of 
some  &x(tc)  on  the  objective  function,  J, 
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